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Malts media Program 80&km&r§dtog System 

CROSS REFERENCE TO RELATED APPLICATIONS 

Tlits application claims benefit of XLS, Provisional Application Mo. ^0/127^1 71 
March 3D, 1999. 

mcMmmmmri 
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TECHNIOVL FIELD 

The hiveotion relates to controlling multimedia program material In a computer 
15 emdronment More panic Marly, the mvemiOB relates to recording and storing user 
booktHarlcs for stored program maienal in a compter envlromrsent 

DESCRIPTION OF THE PRIOR ART 

20 Multimedia devices such as VCXI& DVD players, MP3 players, cassette players, CD 
players, video tape editors, and the new eiass of Persona! Video Recorders (PVR) are 
extremely popular with co Almost every household m the "United States has 

at least oue of : these devices, 

25 Muidmedia deviees are typically designed as linear devices. This mesms that the 
program materia! is perceived m hekg one long piece, even though several different 
programs, songs, etc, exist, on the pmgram media. For example, a cassette or VCR. 
tape can have multiple songs or programs on a single media. 

30 Digital systems smh m CDs* DVDs > and MP3 players have the added afeOity to j xmrp 
to m mim of a song or program within Its media, 
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The typical multimedia device allows the user to stop at a pouu within th& m&immd 
to return, to that ..particular point upon startup. The drawback to these devices is that 
the user does not have the ability to watch or listen to several songs or programs 
within the media and place bookmarks at the points where he has stepped the 
5 playback. They only provide the ability to return to a single point in the media. 

Simple systems such as VCRs are mechanical and simply stop at a certain point in the 
tape when the user turns the device oil The user powers the m^fne back on and 
continues play ing the tape, 

10 

It would fee advantageous to provide a multimedia program bookmarkmg system, that 
allows a user to save and retrieve bookmarks for several audio and/or video programs 
on a single device. It would further be advantageous to provide a system that allows 
multiple users to save and retrieve their own personalized bookmarks on the same 
IS device. 



20 The invention provides a multimedia program hookmarklag system. The system 
allows a user to save and retrieve bookmarks for several audio author video programs 
on a single device. In addition, die invention provides a system that allows multiple 
users to save and retrieve their owu personal i/cd program bookmarks on the same 
device, 

A preferred embodiment of the iuvenbon provides a bookmark function that allows 
the user to bookmark a program where he left oft The Invention records the ftame of 
the program where the user stopped when the user commands the system to do so.. 
Alternatively, the invention auiomaticaily bookmarks the program fer the user if the 
30 user exits viewing the program. The invention displays ao indicator indicating that a 
bookmark has been saved. The user cam at any time, access his bookmark and 
continue playback of the program irons where be left off 
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Bookmarks within a single program can be set for different users. Wymote controls are 
encoded for a specific user m a household. This allows each person in the household 
to have a pes-sonal remote eojttro! and therefore, personal bookmarks. The invention 
notes that a set of bookmarks belongs to a certain encoded remote control, lite user 
can alternatively select a speci he set of bookmark s manually, through a menu, 

me system loads the associated bookmark Infornmilon for the user. Any bookmarks 
that do not have associated programs stored on she storage device ate ignored and 
deleted. The invention plays hack programs starting hfont the associated hoofemarks, 
if they exist. 

Multiple bookmarks for a program are transparent to the user because foe remote 
control thai the user uses tells the system to only display and activate thai particular 
userOs bookmarks. 



Other aspects and advantages of the invention will become apparent from the 
following detailed description in combination with the accompanying drawings, 
illustrating, by way of example, t he principles of the Invention.. 

BgA Is a Meek schematic diagram of a high level view of a preferred embodhnsnt of 
the invention according 50 foe invention; 

Fig, 2 is a block sehenmtie diagram of a preferred embodiment of the invention using 
multiple input and output modules according to the Invention; 

Fig, 3 is a schematic diagram of an Moving Pictures Experts Group (MPEG) data 
stream and its video and audi o components according to the invention; 

Fig, 4 is a block schematic diagmtn of a parser and four direct memory access (DMA) 
input engines contained in the Media Switch according to the invention; 

.3 
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Ftg< 5 Is a : ■■schematic diagram of the. components: -of a packeiized elementaxy stream 
(FES) buffer according 10 the invention 

5 fig.. 6 is a schematic diagmm of the construction of a PES buffer irom fee parsed 
components in the Media Switch output circular bnffem; 

Fig, 7 h a block sctemaiic diagram of the Media Switch and the various components 
that it communicates whh according to fe kwatiom 

10 

Fig. $ is a block schemat ic dlagmm of a high level view of the progmm logic according 
to the invention) : 

Fig. 9 h a block schematic diagram of a class hierarchy of the program logic according 
1 5 to the Invention: 

Fig, til is a Mock schemata diagram of a preferred embodiment of the clip cache 
component of tbe invention according to the invention; 

20 Fig. I I h a block schematic dkgmm of a preferred embodiment of the invention that 
emulates a broadcast studio video ndxer recording to the Invention: 

Mg* 12 is a block sehem&oe diagram of a closed caption parser according to the 
invention; 

25 

Fig> 13 is a Mock ^ level view of a preferred embodiment of 

tie Invendon utilizing a VCR. as an integral component of the invention according to 
the invention; 

30 Fig. 141$ a diagram of a remote control according to the invention; 



4 



SUBSTITUTE SHEET (MILE 26) 



Fig, 15 is a block schematic /dt^rsam .of 'a bigft. level view of n preferred ^mboaiment of 
the mntido showing the viewer interface module intemetfen seemxiiag m the 
mvendom 

Fig. 16 :k a setemaiic diagram of a central menu screen according to the invention; 

Fig. 3 7 is a schematic digram of a program Ilsv screen according to the teventfa; 

Fig, 18 is a schematic diagram of a detaited program information mmm according to 
the invention; 

Fig. 10 h a schematic diagram of a detailed program information screen according to 
the invention; 

Fig, 20a Is a sehemade diagram of a small banner displayed over program content 
according to the invention; 

Fig. 20b Is a schematic diagram of a medium bamer displayed over program concern 
according io the invention; 

t\g, 20c k a schematic diagram of a detailed banner displayed over program content 
according to the invention; 

Fig. 21 is a schematic diagram of a suggested program list screen according to the 
invention; 

Fig, 22 is a schemafe diagram of a network listing screen according to the in vention; 

F% 23 is a schematic diagram of a program theme list semen according io the 
Invention; 

Fig, 24 m a sehematfe diagmm of a todo list screen according to the invention; 

5 
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Fig. 25 Is a mhmmm diagram of a conflict warning screen according m the mvmdon; 

fig, 26 b a schematic d^rain of a trick play bar overlaid on p^gram Materia! 
aciedtfimg to the mvottios;' 

Pig, 27 & a schematic diagram of a the trick bar and its associated conipo^ms 
according tdtJie mv^Mion; 



Fig> 2S is a schematic diagram of a two column multimedia schedule screen accordmg 



Fi|> 29 is a schematic diagram of a two column feme-based schedule screen acc 
to" the invention; 



Fig, 30 is a schematic diagram of a two column toie-based schedule sc^ea accordmg 
to & Invention; 

Fig, 3! ba thematic diagmm of a two eokmin thm^hased schedule screm aeeo^ng 
■to the invratioa; 

Fig, 32 b a schematic dbgmm of a two column program schedule screen according to 
the invention ; and 

Fig, 33 la a schematic diagram of a two. mimm promm schedule screen showing a 
program duration mdieatof according to the mveMkm, 
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gMMLMM mscmrtioH of the invention 

The invention is embodied in a omhimedia program bookmaddng system in a 
S computer environment A system accoMlsg m the invention allows a met to save and 
mwm hm^mmks for several audio anddot video programs on a single device, fa 
addition, the Invention provides a system that allows multiple users to save and 
retrieve their own personalized program hooteaxfes m foe same device. 

1 0 A preferred embodiment of the invention provides a honkmark foneioB. that allows 
foe user to bookmark a program where he left off. Bookmarks are stored retrieved for 
the user. The invention also allows different users to save bookmarks within a single 
program with the sets of bookmarks tied to encoded remote controls or accessed 
masuaHy by a user, The invention plays back programs starting from the associated 

I S bookmarksfol they exist. 

Referring to Fig. I, a prefen-ed embodiment of foe invention has an Input Section 1-01, 
Media Switch 102. and an Output Section 103. The Moot Section 101 lakes 
television (TV) input streams in a multitude of forms, for example, National 

20 Television Standards Committee (Nl'SC) or PAL broadcast, and digital forms such as 
Digital Satellite System (DSS), Digital Broadcast Services (DBS), or Advanced 
Television Standards Committee sATSC). DBS, DS8 and ATSC are based on 
standards called Moving Elctures Experts Group 2 (MPHG2) and MFEG2 Transport. 
MPBQ2 Transport is a standard for formatting the digital data stream Horn the TV 

28 sonme transmitier so that a TV receiver can disassemble the input stream to find 
programs in the multiplexed signal. The Input Section 101 produces MPEG streams. 
An MPEG2 transport multiplex supports multiple programs In the same broadcast 
channel, with multiple video and andio feeds and private data. The Input Section 101 
tunes the channel te a particular program, extracts a specific MPEG program out of it, 

30 and feeds it to die rest of the system . Analog TV signals are encoded Into a similar 
MPEG fomtat using separate video and audio encoders, sneh that the remainder of the. 
system is tmawam of bow dm signal was obtained. Information may be modulated 
Into foe Vertical Blanking Interval (YE!) of the analog TV signal in a number of 

? 
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standard ways; for example, the North Americas Broadcast Teletext StaiKte* 
COASTS) mpy be used to modulate Information <>i»o lines 10 through 20 of an NISC 
signal white the FCC mandates the use of line 21 for Closed Caption (CC) and 
tended Data Servicea (EDS). Such signals am decoded by the input section and 
5 passed to the other sections m if they were delivered els as MPEG2 private data 
channel 

The Media Switch 102 mediates between a mtemproeessor CPU 106, hard disk or 
storage device 105, and memory 104. Input streams are converted to an MPEG 
1 0 stream arid sent to the Media Switch 102. The Media Switch 102 bunco; the MPEG 
stream into raemory . It thea performs two operations if the riser is watching real time 
TV: the stream is seat to the Output Section 103 and it is written simultaneously to 
the hard disk or saarage device 105, 



1 5 The Gntput Section 103 takes MPEG streams as input sod produces an analog TV 
signal according to the MTS€, PAL, or other required TV standards. The Onipm 
Section 103 contains m MPEG decoder, Gn-Sereeu Display (DSD) generator, analog 
TV encoder and audio logic. The GSD generator allows the program logic to supply 
images which will be overlaid on top of the resulting analog TV signal. Additionally, 

20 the Gutput Section can moderate information supplied by the program logic onto the 
VP! of the output signal in a number of standard foruvatseineludlng NABTSy CC and 
EDS. 



With respect to Fig. 2, the invention easily expands to accommodate multiple Input 
25 Sections (ixmpm) 201, 202, 203, 204, each can he tuned to different types of input. 
Multiple Oujput Modules (decoders) 200, 207, 208, 200 aw added as well. Special 
effects such as picture In a picture can he implemented with multiple decoders. The 
Media Switch 205 records one program while the user is watching another. This 
means that a stream can be extracted off the disk while another stream is being stored 
30 onto the disk. 

Referring to Fig, 3, the incoming MPEG stoeam 301 has interlcm-ed video 302, '305, 
306 and audio 303, 304, 302 segments, Tltese elements must be separated and 

8 
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meombfoec to create separate video 308 and audi© 309 smms or buffers. This is 
pe«essary becmm mpmm decoders are used to em\>m MPEG elements back, into 
audio or video analog eomposjents. Sued separate delivery requires that time sequence 
Information be generated so that the decoders may he properly synchronized for 
accurate playback of d» signal 

The Media Switch enables the program logic to associate proper time seo^tecb 
information with oaeb segmeriL pcssibly embedding it directly into the stream. The 
time sequence information for each segment is called a ikm stamp. These time stamps 
am mormtenicaliy increasing and start at zero each time the system boots up. This 
allows the Invention to dud any particular spot in any particular video segment. For 
example, if the system needs to read foe seconds into as Incoming contiguous video 
stream that is being cached, the system simply has to start reading forwari into the 
stream and look lor the appropriate time stamp. 

A binary search can be performed on a stored Me to fodex into a stream. Each stream 
is stored as a sequence of feed-sixe segments enabling fest binary searches because of 
the uniform tlmestsnmlng. If the user wants to start m the middle of the program, the 
system performs a binary search of the stored segments until It finds the appropriate 
spot, obtaining the desired results with a minimal amount of fofornaation. If the signal 
wore instead stored as an MPEG stream. It would be necessary to linearly parse the 
stream from the beginning to find the desired location. 

Wstn respect to Fig. 4. the Media Switch contains four input Direct Memory Access 
(DMA) engines dim 403. 404, 405 each DMA engine has an associated butler 410, 
41 L 412. 413. Conceptually, each DMA engine has a pointer 406, a limb for that 
pointer 407, a next pointer 4011, and a iiirtii for the next pointer 409. Each DMA 
engine Is dedicated to a particular type of Information, for example, video 402, audio 
403, and parsed events 405. The baiters 410. 4! I, 412, 413 are circular and coiled 
the specific information. The DMA engine increments the pointer 406 Into the 
associated buff er until Urates Site limii 40? m& then, loads the next pointer 408 and 
limit 409. Setting the pointer 406 and. next pointer 408 to the same xdm, afaag with 
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iiie corresponding limit value creates a circular staffer. The next pointer 408 can he set 
to a different address to provide vector DMA. 

The mm stream fews tlnougb. a parser 401. The parser 401 parses the stream 
6 looking for MPEQ dipiM events indicating the start of video, audio of private 
data segments. For example, when the parser 403 lads a video event, It directs the 
stream to (he video DMA engine 402. The parser 40! buffers up data and DMAs h 
into the video buffer 410 through the video DMA engine 402. At the same time, the 
parser 401 directs an event to the event DMA engine 405 which generates an event 

iO into the event buffer 413. When the parser 40! sees an audio event, it redirects the 
byte stream to the audio DMA engine 403 sad generates an event into the event butter 
413, Similarly, when the parser 40! sees a private data event, it directs the byte 
stream to ths private data DMA engine 404 and directs aa event to the event buffer 
413. The Media Switch notifies the program logic via an interrupt mechanism when 

1 8 events are placed in the event buffet 

Referring to Figs. 4 and 5. the event buffer 4 13 is filled by the passer 401 with events. 
Each event 501 in the event buffer has an offset 502, event type 503. and time stamp 
field 304, The parser 401 provides the type and offset of each event as it is placed 
20 into the huff er. For example, when an audio event occurs, the event type field is set 
to an audio event and the offset indicates the location in the audio buffer 41 1 . The 
program logic knows where the audio buffer 41 1 starts and adds the offset totmd the 
event In me stream. The address offset 502 teds the program logic where the neat 
eveatoceur^ 

25 current event can he found as well as the length of the segment. 

With respect ha Figs. 5 and 6, the program bg|c reads accumulated events in the event 
bailer 602 when it is inKerrupted by the Media S witch 601. From these events the 
pmgmm logic generates a sequence of logical segments 003 which correspond to the 
30 parsed MPEG segments 6 IS. The program logic converts the offset 102 into the 
actual address 610 of each segment, and records the event length 609 using the last 
cached event. If the -stream- was produced by encoding an analog signal, it will sot 
contain Program Time Stamp tPTS) values, which are used by the decoders to 

10 
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properly present the resulting output, thss. the prngram logic uses the generated 
time stamp 504 to calculate a.sBrtted;rafbr.mh S8gmem and places that into the 
logical segment tirmtspirap 607. In the ease of a digital TV stream, PTS values a« 
already encoded in the stream. The program logic extracts this iuionnation and places 
k m the logical segment tfeestemp 607, 

The program logic continues collecting logical segments 603 until It reaches the fixed 
butler size. When this ocm% the program logic generates a new buffir, called a 
Paefcetfeed Elementary Stem (PES) 605 buffer containing these logical segments 603 
in order, pins ancillary control information. Each logical segment points 604 directly 
to the circular buffer.^:., the video butler 6 13, filled by the Media Switch 601. This 
new heifer is then passed to other logic components, which may further process the 
Stream In the hosier in some way, such as presenting it for decoding or writing it to the 
storage media. Thus, the MPEG data is not copied from one location in memory to 
another hy the processor. This results in a snore cost effective design since lower 
memory bandwidth and processor bandwidth is required. 

A uniq ue feature of the MPEG stream teanaformation into PES butters is that the data 
associated with logical segments need not he present in the buffer itself, as presented 
above. When a PES buffer is written to storage, these logical segments are written to 
the storage mediun-t lo the logical order in which they appear. This has the effect of 
gathering components of the stream, whether they he io the video, audio or private 
data circular buliers, into a single linear buffer of stream data on rhe smragc medium. 
The hufle? is read bach from the storage medium wish a single transfer from the 
storage media, and die logical segment information is updated to correspond with the 
actual locations in fee butter 606, Higher level program logic Is unaware of this 
traiisformation, since it handles only the logical segments, this stream data Is easily 
managed without requiring that the data ever be copied between locations in DRAM 
hy the CPU, 

A umtpae aspect of the Media Switch is the ability to handle high data rates effectively 
and inexpensively, P performs the functions of taking video and audio data in, 
sending video afe audio data out, sending video and audio data to disk, and extracting 

11 
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video and audio data from the disk m a low cost platform. Generally, the Media 
Switch runs asyBchroftously ami autonomously with the microprocessor GPU, using 
its DMA capabilities to ntfye large qaamife of information with nianimal 
intervention by the CPU. 

Inferring to Fig, ?, the input side of the Media Switch '701 is eonrteeted to on MPEG 
encoder 703, There are also circuits spec! Ik to MPPG audio 704 and vertical MarMng 
interval pVBl) data 702 feeding into the Media Switch 701. I f a digital TV signal is 
being processed Instead, the MPEG encoder 703 is replaced with m MPEG2 
Transport Demultiplexer, and the MPEG audio encoder 704 and VB! decoder 702 are 
deleted. Hie demoltipiexor multiplexes the extracted audio, video and private data 
channel streams through the video .input Media Switch port. 

The parser 705 parses the Input data stream from the MPEG encoder 703, audio 
encoder "04 and VB! decoder 702, or from the transport demithiplexor in the case of a 
digital T¥ stream. The parser 705 detects the beginning of all of the important events 
in a video or audio stream, the start of ail of the frames, the start of sequence headers » 
ah of the pieces of information that the program logic needs to know about in order in 
hoth properly play back and perform special effects on the stream, e.g. feat forward, 
reverse, play, pause, mshsfow play, indexing, and fast/slow reverse play, 

The parser 703 places tags 707 into the FIFO 706' when it identities video or audio 
segments, or is given private data. The DMA 709 controls when those tags are taken 
out. The tags 707 and die DMA addresses of the segments are placed into the event 
queue 708. Tie frame type Infonnation, whether it is a start of a video ITrame, video 
B-frame. video PTramc, video PES, audio PES, a sequence header, an audio frame, or 
private data packet, is placed Into the event queue 70S along with the offset in the 
related circular buffer where the piece of intbrmatlon was placed. The program logic 
operating m the GPO 71 3 examines events in the circular buffer after it k transferred 
to the DRAM 714, 

The Media Switch 701 has a data bus; 7S I that connects to the CPU 713 and DRAM 
714. An address bus 712 Is also shared between ode Media Switch 701, GPU 713, and 

12 
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DRAM 714, A hard disk or storage device 7.10 is connected w one of the ports of the 
Media Switch 701, The Media Switch 701 outputs streams to m MPEG video 
decoder 715 and a separate audio decoder 717. The audio decoder 717 signals contain 
audio cues generated by the system in response to the user p mammmds on a remote 
control or other interna! -vents. The decoded audio output fom the MPEG decoder 
is dsgl&% mixed 718 with the separate audio signal. The resulting signals contain 
video, audio, md on screen displays and are sent to the TV 716, 



The Media Switch 701 takes in 1-hlt data and sends it to the disk, while at the 
1 0 time extracts another stream of data off of the disk and sends it to the MPEG decoder 
7IS. All of the DMA engines described above am be working a; the same time. The 
Medsa Switch 70 a can oe implemented in hardware using a Field Progranunabie Gate 
Array CFFGAf ASIC, or discrete logic. 

1 5 Rather than having to parse through an immense data stream looking for the start of 
where each frame would he. the program logic only has to look at the circular event 
buffer In DRAM 714 and It can tell w:here the start of each Mm Is and the lame 
type. This approach saves a large amount of CPU power, keeping the real time 
requirements of the CPU 713 small. The CPU 713 does not have to he very fast at 

SO any point in time. The Media Switch 701 gives the CPU 713 as much ikm as 
possible to complete tasks. The parsing mechanised 70S and event queue 708 
decouple the CPU 713 foam parsing the audio, video, and bullers and the real time 
nature of the streams, which allows for ioww costs, it also allows the use of a bus 
structure in a CPU environment that operates at a much lower c loch rate with much 

25 cheaper memory than would he required otherwise. 



The CPU 713 has the ahillty to queue up one DMA transier and can set up the nest 
DMA transfer at i ts leisure. This gives the CPU 713 large time intervals wlthm which 
it can service the DMA controller 709, The CPU 713 may respond to a D MA. 
30 interrupt within a lamer time window because of the large latency allowed. MPEG 
streams, whether extracted from an MPEG2 Iransport or encoded from an analog TV 
signal ..are typically encoded using a teehanque called Variable Bit Rate encoding 
(VSR), This technique varies the amount of data required to represent a sequence of 
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images fey the amounrof movement between those images. This technique can greatly 
reduce the required bandwidth for a signal however sequences with rapid movement 
imsh as a basketball game) m&f be: encoded with much greater bandwidth 
requirements. For example, the Hughes DirecTV -satellite system encodes signals with 
anywhere from 1 to lOMfos of s-eqaired bandwidib. Varying Mm &$m to frame, it 
would he dhfieuh for an> computer system m keep op with such rapidly vary mg 
data rates without this structure. 

With respect to Fig, 8, the program logic within the CPU has fee conceptual 
components: sources 801, transform* 802, and sinks 193. The sources 80 J produce 
huffors of data Transforms go 2 process buffers of data and sinks 803 consume 
htuOers of data. A transform is responsible for allocating and queuing the buffers of 
data on which it will operate. Buffers are allocated as If femprw to sources of data, 
which give them hack sfuiiT, The buffors are dfon queued uneven to sinks as GfellO. 
arid the sink will return, the hufier UemptyD, 

A marce 801 accepts data horn encoders, a digital satellite receiver. It acquires 
buffers for this data from the downstream .transform, packages The data into a buffer, 
to pushes the buffer down the pipeline as described above. The source object Mi 
does not know anything about the rest of the system. The sink 803 consumes 
buffers, taking a buffer from the upstream transform, sending the data to the decoder, 
and then roieasmg the buffer for reuse. 

There are two types of transforms 802 used: spat; a) and temporal Spatial transforms 
are transforms that perform, for example, an image convolution or 
campression/decompressfon on the buffered data that is passing through. Temporal 
transforms are used when there is no time relation that Is expressible between buffer:, 
going is and bully s coming out of a system. Such a -transform writes the buffer to a 
file 804 on the storage medium. The huffor is pulled out at a later time, sent down the 
pipeline, and properly sequenced wifom the stream. 

Referring to fig, % a C** elm htemchy d&fmiim of the program: logic is shown, 
The TiVo Media Kernel (Tmk) 904, 908. 913 mediates with the operating system 
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kernel The kernel provides; ope?ations sues as: armory slk&atioa s^chroatmios^ 
and threading. The TnfoCore #4, 908, 913 structures memory taken from die media 
kernel -as as object. It provides operators, new and delete, for constructing and 
deeonstmedng the object, Each object (soofee 90l> transform 902. and shut 903) is 
mmtwhmaded by defetilon md tmtm m parallel. 

The tmkPipciine class 903, 909, 914 is responsible for flow contM through the 
system, The pipelines point to the mxi fi^lm^m^ ^m from sootee 901 to sink 
903. To pause the pipeline, for example. ;m event called QpauseLls sent to the first 
object in she pipeline. The event is relayed on to the next object and so on down the 
pipeline. This ah happens asynchronously to the data going thraugh the pipeline. 
Thus, similar to applications such as telephony, control of the flow oh MPEG streams 
Is asynchronous and separate frorn the streams themselves, This allows for a simple 
logic design that is at the same time power&l enough to support the features described 
previously, including pause, rewind, fast forward and others, in addition, this 
structure allows fast and efficient switching between stream sources, since berTered 
data can fee simply discarded and decoders reset using a single event, alter which data 
torn the new stream will pass down the pipeline. Such a capability is needed, for 
example, when switching the channel being captured by the Input section, or when 
switching between a live signal from the input section and a stored stream. 

The source object 901 is a TfokSource 906 and the transform object 902 is a 
TmkXfoni910, These ate intermediate classes that define standard behaviors for the 
classes in the pipeline. Conceptually , they handshake butlers down the pipeline. The 
source object 901 takes data out of a physical data source, sued as the Media Switch, 
and places it into a PES buffer; To obtain the buffer, the sourer object 901 asks the 
down stream object In his pipeline Tor a buffer (ailocFsnptyBufl. The source object 
90! is blocked until there Is sufficient memory. This means that the pipeline is self 
regulating; it has automatic flow control. When the source object 901 has lilted tip the 
but er, it hands it back to the traos&rm 902 through the poshFuHBuf function, 

The. sink 903 is flow controlled as well. It calls nestFuMBuf which tells dae transform 
902 that it. is ready for the next filled buffer. This operation can block the sink 903 
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mill a bsff# is ready. When the sink 903 is finished with a buffer (/.*., It has 
oossumed the data m the buffer) it calls refeaseEmpry Buf. EefeaseEmptyBuf gives 
the buffer back to the transform 902, The transform 902 can then hand that buffer, 
for example, hack to the source object 901 to fill up again, in addition to the 
automatic flow-coatrol benefit of this method, it also provides for ihrtiting the amount 
of Memory dedicated to buffers by allowing enforcement of a fixed allocation of 
buffers by & ImSsfetm. This is an important feature in achieving a eost-effective 
limited DRAM environment. 

The MedlaSwheh ekss 909 calls the ailocEmpsyOuf method of the TmkClipCaehe 
91 2 object and receives a PES buffer from It , It then goes out to the circular buffers in 
the Media Switch hardware and generates PES buffers. The MediaS witch class 909 
©is the buflcr up and pushes icbaek to the TmkeilpCaehe 912 object. 

The TrafcCHpCaehe 912 maintains a cache file 918 on. a storage medium, ft also 
maimalns I w pointers into this cache ; a push pointer 919 that .shows where the next 
buffer cosning from the source 901 Is inserted: and a current pointer 920 which points 
to the current buffer used. 

The buffer that is pointed to by the current pointer is handed to the Vela decoder class 
91b. The Vela decoder class 910 talks to the decoder 921 in the hardware, The 
decoder 921 produces a decoded TV signal thai is subsequently encoded into an analog 
TV signs! ia NTSC, PAL or other analog format When the Vela decoder class 916 is 
finished with the buffer It calls releascEmptyBuf 

The stmcture of the classes makes the system easy to test aid debug. Each level cat 
be tested separately So make sure it performs in the appropriate mmmt* and the 
classes may be gradually aggregated to achieve the desired fbnctionailty while retaining 
the ability to effectively fust each object. 

The control object 917 accepts commands horn the user and sends events into the 
pipeline to control what the pipeline is doing. For example. If the user has a remote 
control and is watching TV, the user presses pause and the control object 912 scuds 
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an event to the sink 903, ih® tells ft pause. The sink 903 stops asking for new 
buffos. The mmm pointer 920 stays where it is at. 1% 9.03 staffs tasking- 
fenffos ootagain when ft receives another event that tells it to play, The system is in 
perfect synekrom nation; it starts from the frame that it stopped at 

The remote control may also have a fast forward key. When the fast forward key is 
pressed, the control object 91? sends at event to the transform 902, that tells it to 
move forward two seconds. The transform 902 finds that the two second time spaa 
reqiares ft to move forward three buffos, ft then issues a reset event to the 
dowastream pipeline, so that any queued data or state that may he present in the 
hardware decoders is flushed. This is a critical step, since the structure of MPI6 
stteatas reqaires nanmenance of state across multiple frames of data, and that state 
ml) he rendered invalid by repositioning the pointer. It then moves the carrot 
pointer 02Q forward thr«e butlers.. The next time the sink 903 calls nexthniiBal it gets 
the new current buffo. The same method works for fast reverse in that the transform 
902 moves the current pointer 920 backwards, 

A system clock reference resides in the decoder. The system clock reference Is sped 
up for fast play or slowed down for slow play. The sink simply asks for fall huffers 
faster or slower, depending on the clock: speed. 

With respect to Fig. 10. two other objects derived from the TmkXfrm class are placed 
In the pipeline for disk access. One is called TamClip Reader 1003 and the other is 
called TmkCdlp Writer 1001. Barters come into the TrnkCIipWriter 1001 and axe 
pushed to a file on a storage medium 1004. Tmkt ilpK.cadex 1003 asks tor buffers 
which am taken off of a file on a storage medium 1005, A TmfcClipReader 1003 
provides only the afiocEmpiyBuf and pushFuilBuf methods, while a TmkGIip Writer 
1001 provides only the nextfiuUBaf and releaseBmptyBuf methods. A 
I'aikCIipl^ader 1003 therefore performs the same function as the Input, or OpushD 
side of a 13nkeiipCaehe 1002, while a TmkQipWruer 1001 therefore performs the 
same function as the oatput. or 2 pull 3 side of aTmkClipCache 1002. 
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Referring i© Fig. I L a pr^ferft^ embodiment that accomplishes multiple functions fs 
shown. A source I J Oi has a TV signal input The source sends data to a IfoshSwifoh 
1102 which is a transform derived from TmkMmh The PushSwhch 1102 has 
muMple outputs that can be switched by the control objecr I S 1 4 This means that 
one part of the pipeline can fee stopped and another can he started at the users whim. 
The user can switch to different storage devices. The PushSwiteh \M cm\4 otnput 
to a TmkCMpWfiter 1 106, which goes onto a storage device 1 10? or write to the cache 
transform I Ml 



An important feature of this apparatus is the ease with which it can selectively 
capture po rt i on s of ' an. incoming signal under the control of program logic Basedoo 
mf&irostiwsuch aMhe ewmttims, or perhaps a specific time spaa, or perhaps via a 
remote control button press by the viewer, a TmkeiipWrlter 1106 may be switched 
on to record a portion of the signal, and switched off at some later time. This 
switching is typi cally caused by sending a B swi tch Severn In the PashSwIteh i 102 
object. 



An additional method for trigprlng selective capture is through information modulated 
into the VBI or placed: into an MPEG private data channel Data decoded from tie 
VBI or private data channel is passed to the program logic. The program, logic 
.e*»a«*$.ty$ 4mm dettrmme if the datalnfetes that capture of the TV signal into 
which it was modulated should begin. Similarly, this inmnnatlon may also indicate 
when recording shonid end, or another data item may be modulated into the signal 
indicahng when the capture should end. The starting and ending Indicators may be 
explicitly modulated into the signal or other Information that is placed into the signal 
in a standard fashion may be used to encode this information. 

Wife respect to Pig. 12, an example is shown which demonstetes bow the program 
Ipgfc seasts the words contained within the closed caption (CO fields to determine 
starting and ending times, using particular words or phrases to nigger the capture. A 
stream: of NTS€ or PAL OeSds 1201 is presented. CC bytes are extracted from each 
o<M flefd 1202, and entered in a circular buffer 1 203 for processing by the Word Parser 
1204.. Tie Word Parser i 204 collects characters until it encounters a wond boundary, 
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usually a space, period or otfiet defesthig character. Recall fwm above, that the 
MPEG audio and video segments are collected into a series of Ixed-siite PES buffers, 
A special segment is added so each PES buffer to hold the words extracted from the 
GG field 1203. Thus, the CC Inmnnahoo is preserved m fee synchronization with 
&e audio asKl video, aad can be correctly presented to the viewer when the stream is 
displayed. This also allows the stored streaoi to be processed tor GG information as 
the leisure of the program logic, which spreads out load, reducing cost asid lu^pwing 
efficiency, to such a case, the WMds stored m the special segment arc simply passed 
to the state table iogie 1206. 

During stream capture; each word is looked up & a table 1206 which indicates the 
action to take on recognizing that word. This acdon may simply change the state of 
the recognizer state machine 12:07, or may cause the state machine 120? to issue an 
action request, such as G start capture G, G stop capture 2, G phrase seesCother sluhlar 
requests. Indeed, a recognized word or phrase may cause the pipeline to be switched; 
for example, to overlay a different audio track If undesirable language is used in the 
program. 

Mote that the parsing state table 1206 and recognizer state machine 1207 may be 
modified or changed at any time. For example, a different table and state maclhae may 
be provided for each input channel, Alternatively, these elements may be switched 
depending on the time of day, or because of other events. 

Referring to Pig, 1 1, a Pull Switch is added 1 104 which outputs to the sink 1 105. The 
sink 11SS calls nextPuliBuf and reieaseEmptvBuf to get or : return buffers item the 
PoIlS witch 1104. The PuiS witch 1104 can have any number of inputs. One input 
conic be an AetionCIip U 13. The remote control can switch between Ispnt sources. 
The control object 1 1 1 4 sends an event to the PullSwheh 1 1 04, telling it to switch. It 
"^nf^ll^jV^rJ^c^ai^Clpc^Mtt -tfbws-^^ui^^aa^^io^eijue source to whatever input source the control object 
selects. 

An AcbonCilp class provides Ifer sequencing a number of different stored signals In a 
predictable and eontrollabie manrte?, possibly with the added control of viewer 
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selection via a remote control. Thus, k appears as a derivative of a TmfcXfrni object 
that accepts a Zswitck.:.. evem for switching to the next stored sigeaL 

This allows the program logic or user to create custom sequences of video output:. 
Any number of video segments can be lined up and combined as if the program logic 
or user were nsing a broadcast studio video mixer, ImkCllpReaders 1 10S 4 j S09. 1 ? 10 
are allocated and each is booked into the Pall Switch 1104, The PullSwaeb 1104 
swifche*fretf»eei* &^Tft&C%8fe»te4-l08^ 11CR 1 110 to combine video and audio 
dips. Flow control is automatic because of the way the pipeline is constructed. Hie 
Push arid Pali Swhches are the same as video switches in a broadcast studio. 

The derived class am! resulting objects described bore may be combined in an arbitrary 
way to create a number of different nsend eoM%uratlons for storing, retrieving, 
switching and viewing of TV streams. For example, if multiple input and output 
sections are available, one input is viewed wfeile mother is stored, and a picture- in- 
picture window generated by the second output is used to preview previously stored 
streams. Such configurations represent a unique and novel application of software 
transformations to achieve the fanetionality expected of expensive, sophisticated 
hardware solutions within a single cost-efldctive device. 

With respect to Fig. 13, a Mgh-level system view Is shown which implements a VCR 
backup. The Output Module 1303 sends TV signals to the VCR 1307, This allows 
the user to record TV propaum directly on to video tape. The invention allows the 
user to queue up programs from disk to be recorded or; to video tape and to schedule 
the time that the programs are sent to me VCR 130?. Title pages (EPS data) cast be 
MM to d;e VCR 1307 before a program is sent. Longer programs can be scaled to fit 
onto smaller video tapes by speeding up the play speed or dropping frames. 

The VCR 1307 output can also be routed back Into the Input Module DOS. In this 
configuration the VCR acts as a backup system for the Media Switch 1302, Any 
overflow storage or lower priority programming is sen- to the VCR 1307 for later 
retrieval. 
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The Input Module 130! can decode and pass to the remainder of fife system 
information encoded, on the Vertical Blanking Interval (VB1), The Output Module 
U03 cm encode into the &mpm VB1 data provided by the remainder of the system. 
The pmgmm logic may arrange to encode Identifying information ot various kinds into 
the output signal, which mil be recorded ome tape using the VCli 1307, Playing tins 
tape back Into the input allows the program logic to read back this identifying 
intaMioo, such that the TV signal recorded on me tape Is properly bandied. For 
example, a particular program may be recorded to tape along with information about 
when It was recorded, the source network, etc. When ibis program is played back into 
the Input Module, this information can be used to control stomge of the signal, 
pmseutation to the viewer, etc. 



One skilled in the art will readily appreciate that sued a mechanism may be used to 
Introduce various data Items to Aeprogcam logic wibch are oat properly conceived of 
as television signals. For instance, software updates or other data may be passed to 
the system., The program logic receiving this data from dso television steam may 
impose controls on how the dam is handled, such as requiring certain authentication 
sequences and/or decrypting the embedded Information according to some ■previously 
acquired key. Such a method works tor normal broadcast signals as well, leading to an 
effieieat moans of providing non-TV control information and data to the program 
logic. 

Additionally, one skilled in the art will readily appreciate that although a VCR is 
specMcally mentioned above, any multimedia recording device fo.yy, a Digital Video 
Disk-Random Access Memory (DVD-RAM) recorder) is easily substituted in its 



One skilled in the art will readily appreciate that other applications may be 
substituted for those set form herein without departing from the spirit and scope of 
the present invention. For example, the invention van be used In the detection of 
gambling casino crime. The input section of the invention is connected -o the casino Os 
video isurveiilanee system. Recorded video Is eaebed and simultaneously output to 
external VCEs, The user can switch to any video feed and examine (L e, . rewind, piny , 
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slow play, fest forward, etc,} a specific segment of the recorded video while the 
external VCR* are being loaded with the real-time input video, 

Be&rriag agaio to Fig. 1, a p^feired emlk^meat of lfie Invention provides a viewer 
Mterfaee. that allows the viewer to access different function::: of the system. The 
sysfemOs construct allows items called video loopsets to be stmk® the hard disk or 
storage device m. fie video loopsets ester lite system forough input streams Into 
the Input Module 101 and convened to MM® smmm and placed onto the storage 
device by the Media Switch 102, lie video loopsets also enter the system in the 
form of MPEG stmams (through a backchnnnd. VBL transmission media, etch 
bypass the MPEG conversion cycle by the Input Module 101 and are written to the 
storage device I DS by the Media Switch 102, 

The viewer interface program logic (executed by the CPU 106) commands the Media 
Switch 102 to retrieve a video Inopset from the storage device 105. A video loopset is 
a. three to four second (the length is dependent upon the amount of information 
displayed and can be lunger) loop of video is created so that foe ending and beginning 
seamlessly merge together to give the client of a continuous video stream as the 
system plays the loopset from beginning to end, looping hack to the beginning of the 
loopssi each time the end is reached. As detailed above, the Output Section 103 fakes 
MPEG video loopset streams as input and produces an analog T¥ signal according to 
the NTSC PAL, or other required TV standards. The Output SectioaOslDS OSD 
generator allows the program logic to overlay text and graphics on top of the resulting 
analog TV signal. 

A lower level viewpoint of the system is shown in Fig. 7, The CPU TO tells the 
Media Switch 711 that a specific video loopset must fee retrieved trom the storage 
device 710 and sent to the MPEG decoder 715. On screen displays are created by the 
CPU 713 and routed through the OSD generator to the digit.*: mixer 718. The digital 
mkerTif allows video loopsets, on screen display s, and audio cues to foe mixed and 
sent to the TV or monitor 716. 
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The iaventionDs viewedntertaee reacts to user input through an input device such as 
the acerapkry mmote control shewn in Fig, 14, With respect to Fig. 15, the userOs 
commands are processed throup the Control Jnpm Module 1504, The viewer 
interface 1503 processes the input eotmtMuds. Appropriate commands are issued 
(mck M displaying Ioopsets) to the Media. Ca-troi 1501. Oa screen displays are 
generated by fo e viewer imerfoce 1503 and mated through die Output Module 1505 
as described above, 

A viewer using this type of remote control 1401 presses the TiVo button 1401 sad 
the viewer interface displays a mm as shows In Fig, 10, TiVo Centra! MM is a 
central legation that contains a list of areas that the viewer can visit and Is easily 
accessed through a single htstton push on the remote control. 

The viewer interface displays video Ioopsets in the background ares of the screes on a 
TV or monitor. Here, the character 1602 in 0k upper left-hand portion of the screen 
m a separate video loopset. The character d sloopset arhmstes the character 1602 by 
giving the viewer the sense that the character Is alive. His antennae move and he meks 
from side to side on his feel, Bach element of the screen can be a separate video 
loopset The subdued tesaps 1603 loopset roiatestbe text In a banner-like mode iom 
the right side of the screen t o the left side. The rest of the background details are on 
another loopset. t)ne loopset cast he used for the entire background display if so 
desired. Vsdeo Ioopsets free the ePU from lhaving ie draw continuous animations. 
The sy stem simply plays the ioopsets in the same manner as playing any other 
MPEG stream, thereby offloading the CPU, Additionally, video ioopsets are an 
inexpensive method of displaying high resolution graphics. 

Any temporal elements (e.gu names, ieem, location mdicators) are drawn onto the 
screen over the video loops using the OSD, Menu items sttch as Mow Showing 1604 
are drawn over the video loopset. A highlight bar 1605 is used to Indicate the current 
meau l^ll^ ^ be selected by foe user . 

Highlight bars can be displayed using video Ioopsets, The highlight bar 1605 appears 
to he &f&v® onto the screen but is actually a video loopset. Each time the user 
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presses a button !4D3 on the remote controlm move the highlight bar 1605. a* 
appropriate video loopset is selected lot that position. 

Alternatively, the highlight bar 1605 ea«be drawn over the video loopsets in the same 
xmxmst as a temporal Item . 

Is mmm wummm mschmQ Ibnnai The user navigates through 
menus by moving to the right (iw passing right side of the button 1 403 oo the remote 
controls to &htmn more intonation or to the left (by pressing the left side of the 
Button 1403 on the remote control) to see Less information and return to the previous 
location. The select button 1404 selects the menu item and causes the appropriate 
action to he executed, 

The Background colors of each set of menus remains consistent throughout the user us 
experience. For example, the background screen color for Now Showing Is 
amber/yellow and the background screen colonic Network Showcases is purple. The 
user intuitively knows what menu area he Is in through the color cues. 

interring to Figs, 14. 16, and 1.7, the invention provides O whispering arro ws □ 1?06 ; 
1707, 1708, 1709 on each screen that tell the user that more information is available k 
that particular direction. These arrows point up 1769, down 1707. left 1708, and 
right 1 706. A right arrow 1706 indicates that there is more detailed content thai the 
user can access by pressing the right side of the button 1403 on the remote control 
1401. A left arrow 1708 indicates that a more general, level, of detail exists that the 
user can access by pressing the left side of the button 1403 on the remote control 
mi, Up 1709 and down 1707 arrows Indicate that the current list has more items 
above or Mow, respectively, from the location that the user enrrmitly has highlighted 
with the highlight bar 1710. If an arrow does not exist then there is nowhere else to 
go in that. direction. 

For example, the user simply highlights the Now Showing name 1604 and presses the 
fight side of the button 1403 on the remote control 1401, The Now Showing screen 
1701 is shown which has a list of programs 1705 that are displayed to the user in 
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descending order with the most recently obitim4 program at the top of the list. The 
Now Showing listing 1703 contains a ikt of shows that the user requested the system 
to tecord and also programs that the system believes are of interest to the user. The 
system u s list is based upon the program preferences that the user hatexpressed to the 
system using the thumbs up and thumbs down ratings described below and am 
Indicated with a TWe logo 1712, A yellow del 1 702 is a warning in&mt that 
indicates that a program Is going to expire and will be deleted from the hard drive m a 
short, time (e,g< x in 24 hears)* A yellow slot with an exclamation point 1 704 indicates 
that a program will be deleted within a much shorter rime (e.g., within the next few 
honrsfe Green dots 1703 indicate that the system will save the program until the user 
explicitly deletes it, A red dot 1713 indicates that the program is currently being 
saved on the storage device 

A down arrow 1 7 ! I is displayed in the lower area of the listing 1703 whenever the 
user has more information to scroll or page down ihrougb, An up arrow is displayed 
in. the upper area of the listing 1705 whenever there is more information to semi! or 
page up through The user presses up or down on foe button 1403 on the remote 
control 1401 to scroll up or down, respectively, through the listing. The channel 
button 1410 is pressed up or down so page op or down, respectively, throutm the 
listing. 

When the user presses on the right side of the button 1403 on the remote control 
140!. a more detailed program information screen Is displayed to the user, Referring 
to Fig. 18, this screen supplies the user with more infennation related to the partteular 
program. The user can choose to let the program be deleted automatically by taking 
no action 1805. view it immediately 1801, delete it immediately 10% ask the 
Invention to save the prograai longer 1802, or save until deleted by the user 1802. If 
fee user asks the Invention to save the program longer, then the yellow or yellow dot 
with an exclamation point will disappear. The user can also save a program to an 
external VCR for archiving 1801 The invention consistently displays the highlight 
bar 1806, whispering arrows 1810, 1811, 1812, and video ioogsets 1807, A test 
description of the program 1 800 is displayed. 
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A down arrow 1813 is shown in the lower portion of the screen to indicate that the 
user can press down on the channel button 1410 on the remote control 1401 to see a 
detailed program information screen for the nest program on the Now Showing list, 
An up arrow displayed In the upper portion of the screen area indicates that the 
proswam list has additional programs in that direction. This fonetioBality allows the 
user to obtain t^^^^ |705 ; n a more 

detailed format 

With respect to Figs, ?. IS, and 18, foe invention provides a bookmark kmiim thai 
allows the user to bookmark a program where he left off. The CPU 713 records the 
ftame of the program where the user stopped or the user commands the system to 
place a bookmark. The Media Switch 701 updates the CPU 713 on the status of the 
i isivD Mi --ui^l 1 or cXdiiiplCv a user c<x$\ w&ccb lbs .first r»ss?~hot$r of & two -hour pro&ni&i 
Stored in the storage device 710 and then bookmark the program where he left off or 
he can place bookmarks withis foe program to mark poinis of interest Alternative^, 
the invention auiomatically bookmarks the program for the user if the user exits 
viewing the program by going to live TV or to the menu mode. The invention places 
an Indicator 1701 ou the screen, indicating thata bookmark has been saved, 

The user can, at any time, access any of his bookmarks and continue viewing the 
program from the bookmark. When a program is deleted fern the storage device 718, 
the associated bookmarkfo) is also deleted The user can also select and delete a 
specific bookmark or all bookmarks for a program. Once the program is playing, the 
user eanjurfup to a bookmark using the jump hotton 1414 on the remote control 14-01 
and press the select button 1406 to remove the bookmark. A bookmark is placed in 
the same manner by pressing the select button 1406 to create a bookmark. 

Bookmarks within a single program can he set for difierom users. Remote eontrois am 
encoded for a specific user in a household. This allows each person in the household 
to have a personal remote control. Ine advantage to having individual remote eontrois 
is thai parental controls, personal preferences, and bookmarks are aumnmtieally 
activated when each remote control Is used. The CPU 713 notes that a bookmark 
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belongs to a certain erscoded mxiots control. Each set of date are s to red on the storage 
device 710, 

The remote control identifies itself to the system via a coded chip onboard she remote 
5 control The Control input Module 1504 receives the remote control: psconimand 
signals. The viewer laterface 1503 processes the remote control □sideniificatfon and 
eheeks the preferences on the storage device 1502 for any assoeiated pelerence Ilea 
The viewer in mf&m 1503 then uses the associated preference file (or default 
preference file If no match was found) bookmark information for fee user. Any 
1 0 bookmarks that do not have associated pro grains stored on the storage device 1 502 am 
Ignored and deleted. The viewer interface 1503 commands foe Media Control 1501 to 
display programs wife start frames corresponding to the preference tie bookmarks, if 
they exist. 

I S The encoded remote control can also he used for parental controls. Specific remote 
eontroi(s) can be set up so that different levels of parental controls are engaged for 
each remote control Children, for example, will have their own personal remote 
controls that are set up to not allow them to watch any shows with greater than a G- 
rating. 

20 

One skilled In the art will readily appreciate that, although coded remote controls are 
mentioned as a method of accessing individual user preference files; other methods 
such as manna! selection can he used. 

25 Multiple bootetarks Tor a program are transparent to the user because the remote 
control that fee mm uses tells the system to only display and activate that particular 
nserOs bookmarks. A user can also see other users □ bookmar ks If so desired . 

One skilled in the art will readily appreciate that the Invents on □ sbookmarks can be 
30 applied to any video or audio application where foe physical position la the material 
is readily ascertainable e.g.. DVDs. VCRs, M&8, etc, 

a? 



Users can indicate ihpk pmtmmes for a cermio. program, A user can rale a particular 
program with either one. two, or three thambs up, Indicating the degree that he fa 
fee program. One. two, or three ihambs down are used to indicate the degree that the 
user dislikes the program. The degree that the user likes or dislikes the program 
increase as the number of thumbs up or down increases two thumbs up 
indicates a stronger preference than one thumbs up). 



The user ecu rate a program while he Is waicMng it or viewing the progmmOs 
Information. The accumulation of program ratings allows the system to save related 
prngmm onto the system storage device. This influences the performance of the 
underlying system as described in application no, OS owned by the applicant. 

Referring u- Pigs. 19. 20a, 2Gb. and 20c the Invention displays the thumbs rating (if if 
exists) imi for a particular program to the user whenever an episode of the program 
is viewed or the user looks at the program Information 101)8. A banner 200! is 
displayed in the upper region of the screen whenever the user changes channels, 
transitions to live TV, or commands the banner to be displayed. 

The user can rotate through three different levels of banners, each successively 
contaanmg more information about the program. The lowest level banner 2001 
contains minimal Information such as channel 2002, station ID 2003, and time 2004. 
The second level banner 2005 displays, in addition to the information in the minimal 
banner 2001, infonnahon. such as program ti tle 2006, d uKttion 2002, program MP A A 
or TV rating 2008, astd thumbs rating. The final level banner Mm adds program text 
description 2010 to the second level banner .2005,. The program text description 2010 
is semi-transparent, allowing the user to watch the progress of the program while 
reading fee text. 

With respect to Fig. 21. programs that the user has indicated a preface iot and 
other programs that the system believes that the user is intemsted in (through a user 
profile} are displayed 2102 in the TlVoTs Suggestions area 2101. 
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The user can fell the sy stem to record ess Instance of a program, the next x number of 
showings, record all occurrences of a p?opa« fm a set time period, or get a season 
pass to? a program. A season pass tells the system that the user wants to record each 
tint® of a certain program for she entire season. The system notes, for example, that 
the program is shown every Monday at $:0O PM and saves the program on the 
storage device every Monday at 8:00 PM umn she end of the season. A season pass 
will only he offered to the user tf tfeejjtograxa .^'e^jk^jtal^ 

At anytime during the viewing of live television, the user is able to tell the system to 
save the |)K>gram m proem:*, record she program the next time, if any. it Is shown, or 
get a season pass for the program.. If the user is watching a show and tolls the system 
to record use progress- in progress, then the system will record the program from that 
pomi on and will add onto: u ie saved recording (prepending) the portion: of the 
pnagmm that has already passed and has been suffered, The oserOsehoIees will 
appear in his prof I k so he can edit it later, 

Referring to Figs, .22 and 23. a Showcase area 2201 contains program listings that 
eetlain television, or cable networks are promoting 2282, These are programs that the 
networks are currently promoting tern their lineups. The user can, for example, move 
the highlight bar to foe right and look at the network listings, The user cm choose 
NBC 2203 fey highlighting that particular line and moving the highlight har 2204 to the 
right. The m of program categories for NBC will appear on the next screen 2301, 
The user can then move the highlight bar 2303 to lughnght a program category and 
then move the highlight fear 2303 to the right to see the pwgram listings on the next 
iscrmv. 

Referring again to fog, 19, a screen displaying the Information for a program is shown, 
I ne user Is given the thumbs rating if it exists 1001 akmg wlfo a program deseription 
and channel Information. The nser is pfesented with a list of options such as: wateh 
now 1902; reeortl the episode 1903; get a season pass 1004; view upcoming showings 
1905; cancel the parhetdar recording 1906; wd view theme 1907 (which displays 
other shows in the same theme area). 




wood/saw vcT&smmmm 

Willi respect to Pig. 24, BVoCisfo Bo List 2401 contains a JisttBg of the programs 
2402; that the system is going to score on the system hard disk. A list of clays 
$m &c current day is displayed. Each day has a corresponding list of 
programs thai the ^sscro win store on the system hard disk. The user can select the 
day that tic wests m query hy highlighting the particular day and moving the highlight 
bar to ike right A list of programs chat the system will record on that particular day 
is displayed. Alternatively, the hivemion will display the emire list of programs 2402 
with the day 2404 that die program will he recorded listed m line with the program 
name 2407. 



A checkmark next to a program name Indicates that die user has requested the system 
to record the program. Two checkmarks 2403 mean that the program 240? is part of a 
season pass. The user can check or uncheek any program cm the list. The programs 
that are eheckmarked have a higher priority to he stored on the system hard disk than 
the unchecked programs. 

If me user attempts to checkmark too many programs, die invention will notify the 
user that there will he insutficiem room on fee system hard disk. The user is told 
what programs should he freed up from the progranis that are ettetutly or planned to 
he saved on the system hard disk in order to save the desired program. The user can 
accept the systemTs tecommendatlom odie can obtain a listing of what programs am 
corrently stored and scheduled to he stored on the storage device and can ehoose to 
mmove the unwanted programs torn the storage device. The user selects the 
imwaated programs by placing an : X haext to the programOmame or he can let the 
system select the programs that will he removed. 

Referring to Fig. 25, any program schedule conflicts are displayed 2501 to the viewer 
immediately whenever a conflict arises. Such conikcK can he caused, for example, by 
the viewer selecting two programs to be saved that are shown at the same time or have 
overlspplng times when only one toner is available,. 

Referring again to Fig, 14. the viewer can also ass the thumbs op 1405 and thumbs 
down 1404 hnttons on the remote control 1401 to tell the system what actors or 
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types of shows he does or does not prefer, For example, the viewer cm select mmm 
from a list and place one. two. or three thumbs up or down next to a particular aetorus 
name. The viewer can access his favorite actor list and add or delete actors from the 
list favorite directors are designated in ihe same way as favorite actors. The sy stem 
B adjusts to fee viewer. : preferences and suggests programs wife the actors, directors:, 
aad types of shows feat the oser prefers. 

With respect to Figs. 7 and 26, as the user watches a program, a trick play fear 2601 is 
overlaid onto fee live video. The CPU 713 uses fee OSD generator to display the 
10 trick play fear 2601 and It s associated components through the digital mixer 718 to fee 
TV or monitor. The trick play fear 2601 vlsufely inferms the user of fee si*e of the 
circular program cache is and. I f t he cac he is not. at capacity, ho w much of the cache is 
filled. The CPU 713 is informed by fee Media Switch 701 of the dome that is being 
displayed and the cache states, 

15 

Be current program is stored fe a etefear cache as described: above. The gmeo cache 
bar 2602 inside of the trick play bar 2601 Indicates how much of the circular cache is 
filled. Time marks 2603, 2604 are displayed inside the trick play bar 2601 giving the 
user a visual scfemnee point from wMeh to judge the current time aod how fer haek In 

20 time fee cache has recorded. The time marks 2603 s 2604 can be any increment of time 
needed, hut usually arc in half hour or 15 minute increments. Every Mf hour (or 
selected increment}, fee cache bur 2602 slides to the left. The eiurem time Is always 
between the time indicated at right hand side 2610 of the nick play fear 2601 minus 
fee time increment of the middle time mark 2604 when watching live television. The 

25 entire length of the trick play bar 2601 is calculated fey subtracting the time indicated 
on the ieft baud side 2609 of the trick play bar 2601 from fee time indicated on the 
right hand side 261 0 of fee trick play fear 2601, 

A slider 2605 move* along fee trick play fear 2601 and on top of the cache bar 2602, 
30 Tiie slider 260S along with the position indicator 2608 sue linked together and tell the 
user visually where his current position Is wifeirv the program material The slider 
displays fee time mnrk 2605 of the position, A mode indicator 2606 is positioned 
below fee slider 260S and follows the sIiderOs2605 movement. The mode indicator 
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2606 displays whether the user is in play, record, pause, slow play, fast play, fast 
feward flw, 2k, and 3>0. slow reverse play; slow reverse, and fast reverse 2x, a«d 
3s) modes. The fx. 2x, and 3x speeds are sdiostahle by the system to be aay vasiahls 
desired (e.g., 2x. lex, and 32xy 

The cache bar 2602 expands, when the eache has not been Oiled, to die right as mote 
of the program is stored in dwcireaiat cache. If the caclie Is l&d s the cache bar 2602 
simply shifts to she right. When the cache bar 2602 reaches the cud of the right side 
©f the trick play bar 2601, it will shift to the left side of the trick play bar 2601 so the 
right baud end of .the cache bar 2602 is positioned in the trlek play bar 2601 at the 
time mark 2604, The slider 2605 and position indicator 26:01 within the trick play bar 
2601 will also shift io unison with the cache bar 2602, reflecting the current position 
in the cache. The time display at the right hand side 2607 of the melt play bar 260! 
will foe one half hour fiwn die time mark 2604 at the middle of the trick play bar 260! 
(when half hoar meremeots are used). 

The kit half of the trick play bar 260] can also display a compressed tune scale. The 
compressed time scale is used when a large circular cache is used.. Sometimes it is not 
desirable to have the right half of the trick play bar 260 1 indicating a time span larger 
than a Mf M Um -because the cache bar 2602 shifts to the leiVwhen it reaches the 
end of the right side and can be contusing to the user. 

The slider 2603 can be moved anywhere within die cache bar 2602 by the user. The 
user uses the play 14! !, rewind 1407, fast forward 1408, pause 1412, slew motion 
1413, jump 1414, and instant replay I41S hnttons to position the slider 2605, The 
jump button 1414 positions the slider 2605 at the end of the cache bar 2602, While 
the instant replay button 1415 causes the slider 2605 to reposition ten seconds (the 
time span is system adjustable) backwards into the eache fear 2602, thereby allowing 
the user to view a portion of the program in the same manner as an instant replay 
operates in football broadcasts. 

When the user watches a program that has been recorded, the trick play bar time 
indicator on the right hand side 2610 represents the total time of the program. 
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recording. The cache bar 2602 fills the epre trick play bar 2601 indicating that the 
program is stored entirely on the system. If a partial program is stored then the cache 
bar 2602 display s the icHghrofthe pmgmm sa^ed by the system. For example, If the 
user records a program after it has already started and the system does not have the 
beginning of the progratp stored In the cache, then the cache bar 2602 will show that 
the progs-am starts a certain amount of time after the beginning of the program. The 
same type of beha vior occurs when a Jreptoi biiag rosJecl has prematurely ended. 
The cache bar 2602 will cad at the point where the recording stopped. The slider 
2605 *spte the amount of time (eg., one hour) in me program that the user is at 
The mode indicator 2006 operates as described above and below. 

Referring to Fig. 27. the components around the piek play bar are shown. The trick 
play bar is shown by itself 2701. and with the cache bar 2702. slider 2703, and a baih 
hoar timing mark 2704. lite mode Indicator can Indicate that a recording is in progress 
2704. A unique aspect of the Inven tion is that the user can move around the program 
material that has beets recorded while the actual recording is taking place. The slider 
2702 can be moved to any point In the cache bar 2702,. Hie cache bar 2702 indicates 
the progress of the recording. The mode indicator 27QS wiii display any combination: 
of record 2706 and play 2707, re wind (ttee speeds) 2708, 2709, 2710, lust forward 
(thtee speeds) 27! !, 2712, 2713, pause 2714, and slow motion 2711, Examples of 
record eombined with 2x fast forward 2716 and 2s fast forward 2717 are shown. 

The pick play bar and its associated components are drawn over the program content 
for a short duration. The trick play bar appears whenever the user activates any of 
the trick play features/,-., record, play, rewind, fast forward, pause, and slow motion, 
if the mode is either play or record, then the trick play bar and its associated 
components will remain on the screen for a short time period. This removes aav 
obstructions from the program material displayed on the screen and is Par the 
mnyenienee of the viewer. This time period is adjustable by the system, The trick 
play bar and its associated components may be displayed indefinitely if in an editing 
mode or a dedicated trick play display is used. 
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AMUthM\y\ index m bookmark Indicators aw displayed over the triek play bar. 
These marks appear %% for example, a vertical bar that is colored, flagged, or labeled 
uniquely giving the user visual cues .that §® index or bookmark exists In that position. 
Fhe user cast sequential ly jump m each index or bookxTtarfc Indicator by pressing the 
5 iW bxmon 14 14 ou the remote control 1401. Indexes and Bookmarks are easily 
placed or removed by me user as noted above, 

Dae skilled in the art vol readih appreciate that the 1«veotio«0stnek play bar can he 
applied to any video or audio application whore the physical position in the material 
10 is readily asoertaioable e.f M DVDs, VGEs, MF3s, etc. 

Another unique aspect of the InveMion is that the user can watch a pre-recorded 
progrsto stored on the storage device while the system is recording another program 
and stormg it on the storage device. This simultaneous operation is a natural feature 
1 $ of foe architecture of the invention. The number of programs befog recorded and 
stored on the storage device Is extended to die number of tuners or sources available in 
the system. 

lefemng agaio to Ftp, 14 and IS. the inversion predicts the position (overshoot 
20 correction) in the program material where the user expects to be when the user stops 
the last forward or rewind modes. The user commands from the remote control 1401 
are received by the Control Input Module 1504. Ike user initially pkees the 
operations! mode into fast forward or reverse by pressing the fast forward button 
1408 or the reverse button 1407. The viewer interface 1503 tells the Media Control 
2S 1301 to fast forward or reverse the program material , Each successive press of the 
ken forward ! 408 or reverse i 40? buttons places the system tmo the 1 x, 2x, or ex last 
forward or reverse modes, respectively. When the user wants to stop the fast forward 
or reverse progression, he ainirdy presses any other media control button, however 
the play button 141 1 is most commonly used. 

30 

The viewer interface 1503 receives the command from the Coottolinput Module 1504. 
and tells the Media Control 1 501 to stop, The Media Control 1501 sends the viewer 
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mptfmc 1503 the frame positian where tlw program material was stopped. The 
vkwer interface then tells the Media Control 150! to transition to the mode the user 
selected ^passes the Media Control 1501 the frame to start the mode fmm. This 
iMme start position is the present frame with m overshoot eorcxxiion factor added or 
5 subtracted from it 

The mvemfon adapts to the user by remembering how much the user corrects (i.e., 
reverses or fast forwards) after he stops the feat forward or reverse mode (in each 
speed). Correct!©!? factors are calculated hy taMog the userOseorrectlons asfo setting 
13 the factors to the average, mediae, or any other method desired, for each speed. The 
system will adjust the corf eetion factors if It observes that the user continues to make 
corrections. 

The invention also uses a predielioo method: to eerrsetly place the user within the 
IT program upon transitioo out of either mode. The predlctiou method determines if the 
user is m ix, 2x, or 3x fast forward or reverse modes and then automatically subtracts 
or adds, respectively, a time multiple (depending upon the actual speed used for is, 
2x, or 3x) to the frame where the transition was detected and positions the user at the 
correct ixame. The system fine tunes the rime multiple ; if it sees that the user is 
20 consistently correcting after the fast forward or rewfod mode stops. 

Another method initially tests the userGsreaeiion time using a test video, it asks the 
user to press the fast forward 1408 or reverse 1407 button during the test video and 
then asks foe user to position the video to the place that he expected the system to 
25 have been. This time span is then used whenever the user uses the fast Forward or 
reverse modes and is adjusted with a multiple for eaeb speed. 

A final method allows the user to simply set a sensitivity setting that the system, will 
use as a correction factor. The invention will subtract or add a multiple of the factor 
3Q to the release home wheocver the user uses foe last forward or reverse modes, 
respectively. 
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&m skilled ft? the art will readily appreciate that the invention .overshoot correction 
can he applied to any video or audio application where the physical portion in the 
materiaf is readily ascertainable e.g; /DVDs, VGRs, MBs, etc, 

5 With respect to Figs, 7Al 28, 29, 30, and 3 1 the invention displays a program gpkk 
area 280! to the user which is a list of the programs that are cnrremly airing, was 
aired, or is scheduled on live TV. Program pide information is stored on the storage 
device 210. ThcCPh/n parses the program guide information and creates program 
sehsdule information, 

to 

The program guide area 2801 Is semMmnsparcm and overiays on the actual broadcast 
program 2802 dumfoe user is currcmly watching. The user can see how the program 
2802 is progressing while he is broking the program guide schedules 2803, therehy 
uifowiug the user to Immediately switch hack to the program 2802.. For example, the 
15 user switches to browsing the program guide 2803 while a commercial break has: 
■occurred during dm current program, The user sees when the commercial break ends 
and immediately switches back to the pr«gmm 2802. 

A simple touch of the Live TV Guide button 1409 on the remote control 1401 brings 
20 up a central program guide area 280 ! where the user navigates through the program 
schedule ifobtniaiion. The program guide aaea 2803 presems what is on live TV now, 
what is on all channels, and what is on a particular channel that is coming up. The 
invention displays the program guide information in two different modest Wo column 
or force column. Cfonemlly , only two columns are shown on the screen at a time to 
25 dectatter the display and present Che information to the user in a friendlier format. 
The informatfon is not presented in dm traditional ebannefoime grid fommL 

The two column mode 2803 displays the available channels in a rotating endless fist 
fosbion in the leit band column 2804 and the programs for the highlighted channel m 
m the right hand column 2805. The user scrolls or pages up or down through the channel 
list by pressing the button 1403 up or down, or the channel button 1410 up or down, 
respectively. The interface is consistent throughout all columns with respect to 
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scjoiiing andpaglisg, Whispering arrows are also consistent in tfeis jatetfks*, showing 
that mm information exists m fee fedleaied direction. Information k also mote 
detailed as (he highlight bar is moved to the right (successive diselosuref as described 
above, 

S 

The cummi time period 280? is shown above the left column 2804 en the screen, The 
time period 210? is vasilv changed by fee user. The user changes the time period 
210? through a single press of the back 140? or forward 1 408 button on the . remote 
control 140^^^ B elow 

1 0 the time display Is the listing of the channels 2104 available to the user. Next to each 
channel number 21001s the station ID 2810 ami the title 28 U of the current program 
that Is being aired. The user moves fee highlight bar 2812 over the chaoBcl that he is 
interested m aild a description 2806, 2108 of the current program that is sho wing on 
M cbmml 2809 is displayed- 4 preferred embodiment of the invention places the 

IS description area 2800 above the two columns. As the nser changes the time period 
2807, fee program titles 281 ! change to the names of the program that were, are, or 
will fee shown at feat time period 280T The programs m the right hand eolamm210S 
will also change to correspond to toe time period 2107. 

20 Program fefemiaiiOn lor the program cnrreotly showing on the highlighted channel is 
displayed in the upper area 2106. 2108 of the program guide area 28 1 0, All. of fee 
data that fee user needs to know about the program that is currently selected Is 
displayed ha the upper area 2800, 2808, This information includes: the program tide; 
episode title:: program description; the actors or actresses appearing in fee program;: 

2S any advisories; aadio parameters; the genre thai the program is in; start and stop 
times; fee program Gs MP A A or TV rating; the logo of the network thaShe program is 
being broadcast on; the current time; it the program is selected to be recorded; if It has 
been selected as a season pass; if the user has expressed a thombs up or down rating. 

30 'Tim user moves the highlight bar to fee right hand column 280S by pressing the right 
side of the button 1 403 on the remote control 1401 allowing him to scroll through the 
programs 2805 for that particular channel. As each program is highlighted, the 
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program Os mformation (as described; above) is dispiayedln the upper area 2806, 2808 
of the program guide area 2801. 

The right hand column 2805 displays a schedule of the programs far the particular 
ehaaael The schedule begins at the time 280/ indicated above the left column 2B04, 
The program mine 2814 and start time 2S13 are displayed. For example, channel 2 is 
highlighted and the right hand column shows ail of the programs showing from, the 
etitrent or selected time. The user can move the higJiiigte bar up m& ikmti the list of 
programs 2805, scrolling through the time slots for each day in the progmm guide 
mlcrmarion. As described above, a page up or page down function is also easily 
accessed by the user. This saves the user the effort of having to scroll through the 
program list in either eoiamn. 



The channel number and ID 2815 are displayed above the right hand column 2805. 
The user changes the channel number2S15 throiigh a single press of the back 1407 or 
forward 1408 button on the remote control 1401, moving the channel number 2815 
backward or fomard, respectively, through the channel list. The channel list in the 
left hand column 2804 follows the user Dsehamtel selections, scrolling backward or 
forward in the channel list. The program list in die right hand column 2105 changes to 
the programs associated with the channel mnnber 281 S selected by the user, starting at 
the time Indicated 280? above the left, hand column 2804, 

Tne program list in the right band column: 2B0S can he shewn in two Intuitive: forms. 
The first torus 3201 lists the start time 3202 of each program neat to the program 
name 3203. The list 3204 is in descending order from the most recent time to the 
Sates; time 

The second form 3301 also lists the start time 3302 next to each of the program names 
3303. The list 3304 continues the time intervals 3302 by listing each half, quarter 
hour, or selectable intervals. The duration of the program is indicated by an arrow 
3305 extending from the program start tune 3302 down to the propam end time 3306, 
This gives the user a visual cue as to the duration of the program, time slot, 
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'The user can hlgMpt a program arid again move the Mghl ight bar to die right to obtain 
a screes such as the one shown in Fig, 1£, The user is given choices to watch the 
pregmmoow (if the pmgram is currently Wing) 1802, record the episode 1803, get a 
season pass 1804. view a list of the upeommg showings of the program cancel 
the reeorritog (if the pmgmm Is being recorded or is scheduled to he recorded) 1806, or 
view programs in that thenae area 1807, 

Tim km mlmm mode adds a higher level column to the two-cokmrn mode. This 
liters that, conceptually, an additional column Is added to the left of the channel 
column, although visually, only two columns arc displayed at a time. Larger screens 
and higher resolutions will allow all three columns to he displayed at once. The 
po£#&-g&i# :S#iSj8tMjR. ks»«ed in different ways, e.g.:, Ml movies 2901, favorite 
channels 3O0L all channels 3101. ah sports, etc. The first cokwm 3503 contains the 
sorting methods available to the user. The second column 3104 presents the .available 
channels that correspond to the sorting method with the description of the channel 
column consistent with that of the two-column method.. The user simply highlights 
the preferred sorting method with the highlight bar 3102, The sorted channels then 
appear in the right hand column 3104. 

The user can then move the highlight bar to the right hand column 3104 by pressing 
the right side of the batten 1403 on the remote control 1401 allowing him to scroll 
through the channels 3104, The program inlormation tor the highlighted channel Is 
displayed in the upper serpen area of the program guide area as described above. The 
user cm mm again move the highlight bar to the right to obtain the two column 
channel/program format described above. This two column format may differ twhen a 
sort method other than ail channels is selected) la that the channels displayed in the 
let tod column are those that correspond to the sorting method. 

The user presses the Live TV Guide button 1469 again to remove the program guide 
area 280! from the screen and to return to the program viewing mode. 

The invention generates transitional sounds tough the digital raker 718, as described 
above, whenever the user moves the highlight bar to another area. Warning sounds 
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occur wte the user attempts m aetion thai is not allowed e.g,; when lite user tries to 
move the highlight bar to an area that does no? exist ie., where a wWspermg arrow is 
not displayed, These sounds can be turned on or off by the user. 

S Although the inwnhon is described herein with reference to the preferred 
embodiment, one skilled in the an will readily appreciate that other applications may 
he suhstimted for those set forth herein without departing from the spirit and scope 
of the preseor invention. Accordingly, the invention shooJd only he limited hy the 
Claims included below, : 
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wo mmmi 



1 , A process for hmkm ar king a userus position mihin Bxmdm or video pmgram 
$ material comprising the steps of; 
providing m pmcmmt* 
pmvtem$& storage device; 

wherein a plurality of audio and/or video programs arc stored on said stomp 

device; 

10 wkerem said processor plays a program from said storage device to the user; 

receiving user command input; 

detecting thz point where the user exits playing said program or places an 
explicit mark within said program; 

sidrmg said exit point, or said explicit mark: as a bookmark on said storage 

15 device: 

retrieving said bookmark for said program: and 
playing said program starting, from said bookmark. 

% The process of claim I , wherein said storing step stores said bookmark m 
20 response to the user V. s command, 

3, The process of elaim L wherein an indicator h displayed to the user Indicating 
that a bookmark for a program exists, 

25 4, The process of claim U wherein a bookmark is deleted from said storage device 
when the associated program is removed ikmisaki storage device, 

$■>. The process of claim I > wherein the user can, at any time, access a 
md mxmmm vkwmg the associated program from that point 

30 

6. The process of .claim 1 , fcnfeer comprising the steps &f: 
storing a plamlity of user pmflie^ on said storage device: 
accessing She user pmfik for a particular user itom said storage device: 
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wherein said storing step stores said bookmark in a user profile; and 
wherein said retrieving step retrieves bookmarks tmm a user profile. 

7. The process of claim 6, further comprising the step of: 
providing a piuraliry of encoded remote controls; 

wherein each encoded remote control has a Mqm identiiicatioo encoding; and 
wtoin said processor automatically retrieves a oseruspre tile that correlates 
to the mmne -.control being used. 

8. The process of claim b. wherein a user selects a specific user profile stored on 
said storage device. 

9. The process of claim 6. wherein any bookmarks that do not have associated 
programs stored on said stcmige de vice ate ignored and deleted. 

H>. The process of claim I, wherein said processor displays the names of the 
bookmarked programs to the user. 

11. An apparatus for bookmarklng a userGs position within an audio or video 
program material, comprising: 

a processor; 

a storage device; 

wherem a plurality of audio and/or video programs are stored on. said storage 

device; 

wherein sskl processor plays a program from said storage device to the aser; 
a module for receiving user eormnand input; 

a module for detecting the point where the user exits playing said program or 
places an explicit mark within said program; 

a module Tor storing sai d exi t point or said explicit mark as a bookm ark on said 
storage device; 

a module far retri eving said bookmark tor said program; astd 
a module for playing said pro gran; starting from said bookmark. 
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12, lite apparams of dmm I 1 , wherein said storing module stores said bmkmmk 
mrmpmm m the user^'s command 

13. The apparatus of claim J h wherein m indicator is displayed to fee user 
Indicating ; that a bookmark for a program .exists., 

14> The apparatus of claim I k wherem a bookmark k deleted from said storage 
device when the associated progw is removed from said storage device. 

11 Tte apparatus of dmx I L wherein the user can. at any time, access a 
bookmark and eonmme viewing the ^sociated program from that point. 

The apparatus of claim I ! > further comprising: 

a module for storing a plurality of user proilles on said storage device; 

a modute lor accessing the user pmffie for a panietdar user from said storage 

device: 

wherein said storiag module stores said bookmark in a user profile; and 
wherein said retrieving module retrieves b0atearks from a oser profile. 

! 7v The apparatus of clahn 16. father comprising; 
a plurality of encoded remote controls; 

wherem each encoded remoie control has a m)lque idemill cation encoding: and 
wherein said processor automatically reiriwes a userDsproMe thai correlates 
to the remote control being used , 

I $ , The apparatus of claim 16, wherein a user selects a specific user profile stored 
on said storage device. 

Ik The apparatus of claim hx wherein any bookmarks that do not have 
associated progmms stored on said storage device are igiiored and deleted. 

20; Jhp apparatiis of claim 1 1 v wherein said processor displays the names of the 
teotaafed programs to the nsen 
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2L A program mm^m imdkmxmdMt. by a computer, tangibly embodying -a 
program of mmmmns execumbfe by the feompufet to perform method $i$p$ fer 
bookmarkmg a iwD^osltion within ass audio or video prograiivmateriaL comprising 
the steps of: 

pmviding a processor 

provldmg a storage device; 

wteem a plurality of audio and/or video programs are stored m mM storage 

device; 

wherein said pxx>eessor plays a program from said storage device to the user: 
mceiviag user command input; 

deteetmg the pofet where the mer exits playing said program or places an 
explicit mark within said program: 

storing said exit point or *aid expiich matt as a bookmark on said stomge 

device; 

reirkv^ and 
playing £aM program starting torn said bookmark. 

2X m method of claim 2 L wherein said storing step sk^a said bookmark m 
response to t he user U s command 

23, The method of claim 2L wherein an indicator is displayed to the user 
indicating that a bookmark for a program exists, 

24, The method of claim 2 L wtran a bookmark is deleted trom said storage 
device when the associated program is removed foms&id stooge device, 

2S> The method of c laim 2 L wherei n, the user am, at any lime, access a bookmark 
and: eontinue viewing the associated program fern that . point. 

26. The method of el aim 2 1 > further compri smg the steps df : 
storing a phiralhy of user profiles on said storage de vice; 
accessing the ■ user .i?*ofilei.".fer- a= particular user fern said storage -device;. 
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wHttmn said storing step stores said bookmark In a user profile; and 
wherein saM retrieving siep Tetrieves bookmarks from a user profile, 

27. The: method of claim 26, ferfher comprising ..the step of: 
providing a pteabty of encoded remote controls; 

wherein each encoded remote control has a unique identification cricoriia«; and 
wherein said processor automatically retrieves a oserusprolle that correlates 
to the remote -control being nsed. 

28, I he method of claim 3d. wherein a nser selects a specific asser profile stored on 
said storage device, 

29, The method of claim 26, wherein any bookmarks that do not have associated 
programs stored on said storage device are ignored and deleted. 

30. The method of claim 21, wherein said processor displays die names of the 
bookmarked programs to the user. 
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